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Disposition of Claims 

4) ^ Claim(s) 1-27 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) n Claim(s) 1.2.4.5,8,10-16.20-23 and 26 is/are allowed. 
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DETAILED ACTION 

1. This action is responsive to communications: IDS filed on 04/06/2004 and application 
filed on 07/10/2000, which has provisional applications 60/142,745 filed on 07/08/1999 
and 60/156,441 filed on 09/28/1999. 

2. Claims 1-27 are pending in the case. Claims 1, 10, 15, and 20 are independent claims. 

Claim Rejections - 35 USC § 103 

3. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

4. Claims 1, 8, 10, 12-15, 20 and 26 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Bavrakeri. US 6,185,602, filed 10/1998. 

Regarding independent claim 1, Bayrakeri teaches the steps of: 
- obtaining first information including a part of a MPEG-4 BIFS scene description 
stream and at least one coded MPEG-4 media stream (Bayrakeri, col.4, lines 56-67 
and col.5, lines 36-51 and col.6, lines 6-39; obtaining MPEG-4 data stream includes 
elementary streams of object, coded MPEG-4 media stream, and BIFS scene 
description stream); 
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- decoding the first information using a BIFS scene decoder and one or more specific 
application decoders associated with the scene description (Bayrakeri, col. 6, lines 6- 
44; using media and BIFS decoders to decode the digital media BIFS scene data); 

- obtaining second information including a second part of a BIFS scene description 
stream that contains a reference to an external application (Bayrakeri, col.4, lines 56- 
67; col.5, lines 36-64 and figures 2 and 5; user modify scene graph (BIFS scene 
description) through MUI interface using user application. These inherently disclose 
that a reference from the MUI interface, such as the scene graph, state agent and/or 
message agent to user application (external application) must exist when user 
interacts with the MUI interface); 

- decoding the second information using the BIFS scene decoder (Bayrakeri, col.6, 
lines 30-55; using decoders to decode BIFS scene data and external application); 

- composing an integrated scene including one or more decoded MPEG-4 media 
objects and one or more external appUcation objects specified in the decoded scene 
descriptions streams (Bayrakeri, col.5, lines 51-64 and col.6, lines 6-29); and 

- rendering the composed integrated scene (Bayrakeri, col.6, lines 6-29). 
Although Bayrakeri does not explicitly mention about an external application decoder, 

his MUI implementation has to interact with the external user application as explained above and 
thus must have an extemal application decoder to understand information (data) received from 
the extemal application. 

It would have been obvious to a person of ordinary skill in the art at the time the 
invention was made to have included an extemal application decoder to decode information from 
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the user application, since this would have help the MUI API communicates with user 
application (external apphcation) when the system receives interactions from user. 

Regarding dependent claim 8, which is dependent on claim 4, Bayrakeri teaches the 
limitations of claim 1 as explained above. Bayrakeri teaches wherein the reference to an external 
apphcation includes application parameters, and wherein the method includes passing the 
application parameters to the extemal apphcation decoder (Bayrakeri, coL5, lines 35-64; col.7, 
lines 10-15; col.9, lines 60-67 and coLlO, lines 5-20). 

Claim 10 is for a computer system performing the method of claim 1, and is rejected 
under the same rationale. 

Regarding dependent claim 12, which is dependent on claim 10, Bayrakeri teaches the 
limitations of claim 10 as explained above. Bayrakeri 's method is implemented on a computer 
system that decodes information as explained in claim 1 above. Therefore, the limitation of 
"wherein the logic to decode information comprises instruction stored on the memory device" 
must be included. The rationale is incorporated herein. 

Regarding dependent claim 13, which is dependent on claim 10, Bayrakeri teaches the 
limitations of claim 10 as explained above. Bayrakeri teaches wherein the processor unit is an 
application specific integrated circuit (Bayrakeri, col. 3, lines 29-35). 
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Regarding dependent claim 14, which is dependent on claim 10, Bayrakeri teaches the 
Umitations of claim 10 as explained above. Bayrakeri wherein the system further includes a 
network interface (Bayrakeri, col. 3, lines 51-55). 

Bayrakeri does not explicitly disclose and wherein the application is a web browser. 
However, Bayrakeri teaches that user application is a multimedia application (Bayrakeri, col. 3, 
lines 45-48). This suggests that the user application is web browser, since web browser is 
popular multimedia application to the user. 

It would have been obvious to a person of ordinary skill in the art at the time the 
invention was made to have modified Bayrakeri 's system to include a web browser application, 
since web browser appUcation is one of a user application that is popular to the user. 

Claim 15 is for a computer readable medium performing the method of claim 1, and is 
rejected under the same rationale. 

Regarding independent claim 20, Bayrakeri teaches the steps of: 
- obtaining first information including a part of a MPEG-4 BLFS scene description 
stream and at least one coded MPEG-4 media stream (Bayrakeri, col.4, lines 56-67 
and col.5, lines 36-51 and coL6, lines 6-39; obtaining MPEG-4 data stream includes 
elementary streams of object, coded MPEG-4 media stream, and BIFS scene 
description stream); 



Application/Control Number: 09/613,292 Page 6 

Art Unit: 2178 

- decoding the first information using a BIFS scene decoder and one or more specific 
application decoders associated with the scene description (Bayrakeri, col.6, lines 6- 
44; using media and BIFS decoders to decode the digital media BIFS scene data); 
composing and rendering a scene including one or more decoded MPEG-4 media 
objects specified in the decoded scene descriptions streams (Bayrakeri, col. 4, lines 
56-67; col. 5, lines 51-64 and col.6, lines 6-29; composing and rendering a scene when 
the scene graph is not modified); 

- detecting user interactions with the scene requesting activation of an external 
application (Bayrakeri, col.4, lines 56-67; coL5, lines 36-64 and figures 2 and 5; user 
modify scene graph (BIFS scene description) through MUI interface using user 
application. These inherently user interaction with the scene is recognized using user 
application (extemal application) through MUI interface); 

obtaining second information including a second part of a BIFS scene description 
stream that contains a reference to an extemal application (Bayrakeri, col.4, lines 56- 
67; col.5, lines 36-64 and figures 2 and 5; users modify scene graph (BIFS scene 
description), send or receive messages through MUI interface using user application. 
These inherently disclose that a reference from the MUI interface, such as the scene 
graph, state agent or/and message agent to user application (extemal application) 
must exist when user interact with the MUI interface); 

- decoding the second information using the BIFS scene decoder (Bayrakeri, col.6, 
lines 6-44; using media and BIFS decoders to decode the digital media BIFS scene 
data); 
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- re-composing the scene by integrated a sub-scene specified by the decoded second 
information into the scene (Bayrakeri, col.5, lines 51-64 and col.6, lines 6-29, the 
scene is re-composed when the scene graph is modified in interactive applications 
MUI system); and 

- rendering the re-composed integrated scene (Bayrakeri, col.6, lines 6-29). 
Although Bayrakeri does not explicitly mention about an external application decoder, 

his MUI implementation has to interact with the external user application as explained above and 
thus must have an extemal application decoder to understand information (data) received from 
the extemal application. 

It would have been obvious to a person of ordinary skill in the art at the time the 
invention was made to have included an extemal application decoder to decode information from 
the user application, since this would have help the MUI API communicates with user 
application (extemal application) when the system receives interactions from user. 

Regarding dependent claim 26, the limitations of method claim 26 are similar to the 
limitations of method claim 8, and are rejected under the same rationale. 

5. Claims 2, 4-5, 11, 16, and 21-23 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Bayrakeri as applied to claims 1 and 10 above and further in view of 
Suzuki , US. 6,611,262 Bl. 

Regarding dependent claim 2, which is dependent on claim 1, Bayrakeri teaches the 
limitations of claim 1 as explained above. Bayrakeri teaches wherein the reference to an extemal 
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application includes information corresponding to a location node (Bayrakeri, col.5, lines 35-64; 
col.7, lines 10-15; col.9, lines 60-67 and coLlO, lines 5-20). 

Bayrakeri does not explicitly disclose information corresponding to an 
Application Window node. 

Suzuki teaches information identifying a location for a media object within a scene 
includes display position and window size of a node (Suzuki, fig. 10, the size of rectangular to 
view the object Node 2). 

It would have been obvious to a person of ordinary skill in the art at the time the 
invention was made to have combined Suzuki and Bayrakeri to provide information, such as 
location and size of a window to display objects within the scene, since this would have facilitate 
the user to modify the scene graph, as Bayrakeri disclosed that MUX API allows interaction to 
effect a scene description using message or variable type, such as state information, control 
information (Bayrakeri, col.5, lines 51-54; col.9, lines 60-67 and col. 10, lines 5-20). 

Regarding dependent claim 4, which is dependent on claim 1, Bayrakeri teaches the 
limitations of claim 1 as explained above. Bayrakeri teaches wherein the reference to an external 
application includes information identifying a location for media objects within the scene 
(Bayrakeri, col.5, lines 35-64 and col.7, lines 10-15, location to move a media object in a scene). 

However, Bayrakeri does not explicitly disclose a location for an application window 
within the scene. 
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Suzuki teaches information identifying a location for a media object within a scene 
includes display position and window size (Suzuki, fig. 10, the size of rectangular to view the 
object Node 2). 

It would have been obvious to a person of ordinary skill in the art at the time the 
invention was made to have combined Suzuki and Bayrakeri to provide information, such as 
location and size of a window to display objects within the scene, since this would have facilitate 
the user to modify the scene graph, as Bayrakeri disclosed that MUX API allows interaction to 
effect a scene description using message or variable type, such as state information, control 
information (Bayrakeri, coL5, lines 51-54; col.9, lines 60-67 and col. 10, lines 5-20). 

Regarding dependent claim 5, which is dependent on claim 4, teaches the limitations of 
claim 4 as explained above. Bayrakeri teaches wherein the reference to an external application 
includes information identifying a location for media objects within the scene (Bayrakeri, col. 5, 
lines 35-64 and coL7, lines 10-15, location to move a media object in a scene). 

However, Bayrakeri does not explicitly disclose information identifying dimensions of 
the application window. 

Suzuki teaches information identifying a location for a media object within a scene 
includes display position, window size and dimensions (Suzuki, fig. 10, the size of rectangular to 
view the object Node 2; and col. 1 , line 49 - col.2, line 46). 

It would have been obvious to a person of ordinary skill in the art at the time the 
invention was made to have combined Suzuki and Bayrakeri to provide information, such as 
location, size, dimensions to display objects within the scene, since this would have facilitate the 
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user to modify the scene graph, as Bayrakeri disclosed that MUI API allows interaction to effect 
a scene description using message or variable type, such as state information, control information 
(Bayrakeri, col.5, lines 51-54; col.9, lines 60-67 and col. 10, lines 5-20). 

Claim 11 is for a computer system performing the method of claim 2, and is rejected 
under the same rationale. 

Claim 16 is for a computer readable medium performing the method of claim 2, and is 
rejected under the same rationale. 

Regarding dependent claims 21-23, the limitations of method claims 21-23 are similar 
to the limitations of method claims 2, 4, 5, respectively and are rejected under the same rationale. 

Allowable Subject Matter 

6. Claims 3, 6-7, 9, 17-19, 24-25 and 27 are objected to as being dependent upon a rejected 
base claim, but would be allowable if rewritten in independent form including all of the 
limitations of the base claim and any intervening claims. 

Conclusion 

7. The prior art made of record and not relied upon is considered pertinent to applicant's 
disclosure. 



Application/Control Number: 09/613,292 Page 1 1 

Art Unit: 2178 

Basso et al., US 6317131 B2, filed 07/1998, teaches interaction modalities for multimedia 
delivery and presentation using nodes. 

Eleftheriadis et al., US 6,092,107, filed 04/1998teaches system and method for 
interfaceing MPEG-coded audiovisual objects permitting adaptive control 

Haskell et al., US 6,654,931 Bl, filed 01/1998, teaches system and method for playing 
browsing and interacting with MPEG-4 coded audio-visual objects. 

Deutsch et al., US 6,631,403 Bl, filed 05/1998, teaches architecture and application 
programming interfaces for java enabled MPEG-4 (MPEG- J) systems. 

Tomokane et al., US 6,665,318 Bl, filed 05/1999, teaches stream decoder. 

Julien, US t,556,207 Bl, filed 07/1998, teaches graphic scene animation data signal with 
quantization object corresponding method and device. 

Jain et al., US 6,463,444 Bl, filed 08/1997, teaches video cataloger system with 
extensibility. 

Mallart et al., US 6,697,869 Bl, filed 08/1998, teaches emulation of streaming over the 
internet in a broadcast application. 

Christine et al, US 6,496,233 Bl, filed 01/1999, teaches conmand and control 
architecture for a video decoder and an audio decoder. 

8. Any inquiry concerning this communication or earlier communications fi-om the 
examiner should be directed to Thu V Huynh whose telephone number is 703-305-9774. The 
examiner can normally be reached on Monday, Tuesday and Thursday. 
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If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Heather R Hemdon can be reached on 703-308-5 1 86. The fax phone number for the 
organization where this application or proceeding is assigned is 703-872-9306. 

Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). 



TVH 

April 29, 2004 




PRIMARY EXAMINER 



